INEX 2010 Workshop Pre - proceedings
نویسندگان
چکیده
This paper gives an overview of the INEX 2010 Ad Hoc Track. The main goals of the Ad Hoc Track were three-fold. The first goal was to study focused retrieval under resource restricted conditions such as a small screen mobile device or a document summary on a hitlist. The leads to variants of the focused retrieval tasks that address the impact of result length/reading effort, thinking of focused retrieval as a form of “snippet” retrieval. The second goal was to extend the ad hoc retrieval test collection on the INEX 2009 Wikipedia Collection with additional topics and judgments. For this reason the Ad Hoc track topics and assessments stayed unchanged. The third goal was to examine the trade-off between effectiveness and efficiency by continuing the Efficiency Track as a task in the Ad Hoc Track. The INEX 2010 Ad Hoc Track featured four tasks: the Relevant in Context Task, the Restricted Relevant in Context Task, the Restrict Focused Task, and the Efficiency Task. We discuss the setup of the track, and the results for the four tasks.
منابع مشابه
INEX 2006 Workshop Pre-proceedings
This paper investigates the measures of retrieval effectivenessemployed in the ad-hoc track of INEX 2006. In particular, it looks athow sensitive the different metrics are to various parameters and howthe choice of certain parameter values may influence the conclusionsof the evaluation. One such parameter which is the main focus of theinvestigation is the methodology employe...
متن کاملINEX 2011 Workshop Pre-proceedings
The goal of the INEX 2011 Book Track is to evaluate approaches for supporting users in reading, searching, and navigating book metadata and full texts of digitized books. The investigation is focused around four tasks: 1) the Social Search for Best Books task aims at comparing traditional and user-generated book metadata for retrieval, 2) the Prove It task evaluates focused retrieval approaches...
متن کاملRelevance Feedback at INEX 2005 Carolyn
Relevance feedback in the INEX environment is addressed by several papers in the proceedings of the INEX 2005 Workshop [1]. The most extensive discussion is provided by Schenkel and Theobald [2]. Mihajlovic, et. al. [3], and Sauvagnat, et. al. [4], describe approaches to relevance feedback in specific sections of papers devoted to discussions of multiple INEX tasks. For detailed descriptions of...
متن کاملFine Tuning INEX
Since 2002, INEX has been the benchmark for evaluating XML information retrieval (XML-IR) systems. INEX has based much of its evaluation methodology on that of existing workshops, albeit modified for the specific requirements of XML-IR. Due to some of the modifications, the time spent during evaluation phase of INEX takes a lot longer than comparable workshops. Here, we investigate ways to spee...
متن کاملReport on the INEX 2003 Workshop , Schloss Dagstuhl , 15 - 17 December 2003
The widespread use of the eXtensible Markup Language (XML), especially the increasing use of XML in scientific data repositories, digital libraries and on the web, brought about an explosion in the development of XML retrieval systems to store and access XML content [BGS03]. These retrieval systems exploit the logical structure of the documents, which is explicitly represented by the XML markup...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010